Pandas Profiling Report

Dataset statistics

Number of variables	10
Number of observations	193573
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	14.8 MiB
Average record size in memory	80.0 B

Variable types

Numeric	9
Categorical	1

Alerts

`carat` is highly overall correlated with `price` and 3 other fields	High correlation
`cut` is highly overall correlated with `table`	High correlation
`price` is highly overall correlated with `carat` and 3 other fields	High correlation
`table` is highly overall correlated with `cut`	High correlation
`x` is highly overall correlated with `carat` and 3 other fields	High correlation
`y` is highly overall correlated with `carat` and 3 other fields	High correlation
`z` is highly overall correlated with `carat` and 3 other fields	High correlation

Reproduction

Analysis started	2024-04-09 18:03:55.482654
Analysis finished	2024-04-09 18:04:18.311958
Duration	22.83 seconds
Software version	ydata-profiling vv4.7.0
Download configuration	config.json

carat
Real number (ℝ)

HIGH CORRELATION

Distinct	248
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.79068785

Minimum	0.2
Maximum	3.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	0.2
5-th percentile	0.3
Q1	0.4
median	0.7
Q3	1.03
95-th percentile	1.65
Maximum	3.5
Range	3.3
Interquartile range (IQR)	0.63

Descriptive statistics

Standard deviation	0.46268774
Coefficient of variation (CV)	0.58517117
Kurtosis	0.53739769
Mean	0.79068785
Median Absolute Deviation (MAD)	0.32
Skewness	0.99513461
Sum	153055.82
Variance	0.21407994
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.3	10758	5.6%
1.01	10103	5.2%
0.31	9538	4.9%
0.7	7958	4.1%
0.32	7548	3.9%
0.9	6253	3.2%
0.41	5852	3.0%
0.71	5367	2.8%
1	5328	2.8%
0.4	4802	2.5%
Other values (238)	120066	62.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.2	30	< 0.1%
0.21	17	< 0.1%
0.22	3	< 0.1%
0.23	889	0.5%
0.24	809	0.4%
0.25	611	0.3%
0.26	722	0.4%
0.27	650	0.3%
0.28	466	0.2%
0.29	354	0.2%

Value	Count	Frequency (%)
3.5	1	< 0.1%
3.4	1	< 0.1%
3.04	3	< 0.1%
3.01	7	< 0.1%
3	5	< 0.1%
2.74	3	< 0.1%
2.72	1	< 0.1%
2.71	1	< 0.1%
2.7	2	< 0.1%
2.66	3	< 0.1%

cut
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.5 MiB

5	92454
4	49910
3	37566
2	11622
1	2021

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	193573
Distinct characters	5
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	4
2nd row	3
3rd row	5
4th row	5
5th row	4

Common Values

Value	Count	Frequency (%)
5	92454	47.8%
4	49910	25.8%
3	37566	19.4%
2	11622	6.0%
1	2021	1.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
5	92454	47.8%
4	49910	25.8%
3	37566	19.4%
2	11622	6.0%
1	2021	1.0%

Most occurring characters

Value	Count	Frequency (%)
5	92454	47.8%
4	49910	25.8%
3	37566	19.4%
2	11622	6.0%
1	2021	1.0%

Most occurring categories

Value	Count	Frequency (%)
(unknown)	193573	100.0%

Most frequent character per category

(unknown)

Value	Count	Frequency (%)
5	92454	47.8%
4	49910	25.8%
3	37566	19.4%
2	11622	6.0%
1	2021	1.0%

Most occurring scripts

Value	Count	Frequency (%)
(unknown)	193573	100.0%

Most frequent character per script

(unknown)

Value	Count	Frequency (%)
5	92454	47.8%
4	49910	25.8%
3	37566	19.4%
2	11622	6.0%
1	2021	1.0%

Most occurring blocks

Value	Count	Frequency (%)
(unknown)	193573	100.0%

Most frequent character per block

(unknown)

Value	Count	Frequency (%)
5	92454	47.8%
4	49910	25.8%
3	37566	19.4%
2	11622	6.0%
1	2021	1.0%

color
Real number (ℝ)

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.5161567

Minimum	1
Maximum	7
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	5
95-th percentile	6
Maximum	7
Range	6
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.6230909
Coefficient of variation (CV)	0.46160937
Kurtosis	-0.81540761
Mean	3.5161567
Median Absolute Deviation (MAD)	1
Skewness	0.15757838
Sum	680633
Variance	2.634424
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
4	44391	22.9%
2	35869	18.5%
3	34258	17.7%
5	30799	15.9%
1	24286	12.5%
6	17514	9.0%
7	6456	3.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	24286	12.5%
2	35869	18.5%
3	34258	17.7%
4	44391	22.9%
5	30799	15.9%
6	17514	9.0%
7	6456	3.3%

Value	Count	Frequency (%)
7	6456	3.3%
6	17514	9.0%
5	30799	15.9%
4	44391	22.9%
3	34258	17.7%
2	35869	18.5%
1	24286	12.5%

clarity
Real number (ℝ)

Distinct	8
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.9750843

Minimum	1
Maximum	8
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	3
median	4
Q3	5
95-th percentile	7
Maximum	8
Range	7
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.5017758
Coefficient of variation (CV)	0.37779721
Kurtosis	-0.10738307
Mean	3.9750843
Median Absolute Deviation (MAD)	1
Skewness	0.66410887
Sum	769469
Variance	2.2553305
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=8)

Value	Count	Frequency (%)
3	53272	27.5%
4	48027	24.8%
5	30669	15.8%
2	30484	15.7%
6	15762	8.1%
7	10628	5.5%
8	4219	2.2%
1	512	0.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	512	0.3%
2	30484	15.7%
3	53272	27.5%
4	48027	24.8%
5	30669	15.8%
6	15762	8.1%
7	10628	5.5%
8	4219	2.2%

Value	Count	Frequency (%)
8	4219	2.2%
7	10628	5.5%
6	15762	8.1%
5	30669	15.8%
4	48027	24.8%
3	53272	27.5%
2	30484	15.7%
1	512	0.3%

depth
Real number (ℝ)

Distinct	153
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	61.820574

Minimum	52.1
Maximum	71.6
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	52.1
5-th percentile	59.9
Q1	61.3
median	61.9
Q3	62.4
95-th percentile	63.5
Maximum	71.6
Range	19.5
Interquartile range (IQR)	1.1

Descriptive statistics

Standard deviation	1.0817044
Coefficient of variation (CV)	0.017497482
Kurtosis	2.4770411
Mean	61.820574
Median Absolute Deviation (MAD)	0.6
Skewness	-0.27638236
Sum	11966794
Variance	1.1700843
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
61.9	10781	5.6%
62	10150	5.2%
61.8	9270	4.8%
62.1	8866	4.6%
61.6	8534	4.4%
62.2	8345	4.3%
62.3	7987	4.1%
61.7	7970	4.1%
62.4	7030	3.6%
61.5	6554	3.4%
Other values (143)	108086	55.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
52.1	1	< 0.1%
52.2	1	< 0.1%
52.7	1	< 0.1%
53.1	2	< 0.1%
53.2	2	< 0.1%
54.7	1	< 0.1%
54.9	2	< 0.1%
55	1	< 0.1%
55.1	1	< 0.1%
55.2	5	< 0.1%

Value	Count	Frequency (%)
71.6	2	< 0.1%
70	1	< 0.1%
69.9	1	< 0.1%
69.6	1	< 0.1%
69.5	3	< 0.1%
69.4	1	< 0.1%
69.2	2	< 0.1%
69.1	1	< 0.1%
69	1	< 0.1%
68.9	1	< 0.1%

table
Real number (ℝ)

HIGH CORRELATION

Distinct	108
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	57.227675

Minimum	49
Maximum	79
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	49
5-th percentile	54.2
Q1	56
median	57
Q3	58
95-th percentile	61
Maximum	79
Range	30
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.9188443
Coefficient of variation (CV)	0.033530006
Kurtosis	0.81018001
Mean	57.227675
Median Absolute Deviation (MAD)	1
Skewness	0.61906223
Sum	11077733
Variance	3.6819634
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
56	42194	21.8%
57	37827	19.5%
58	32045	16.6%
55	24429	12.6%
59	23784	12.3%
60	12584	6.5%
54	8281	4.3%
61	6002	3.1%
62	2545	1.3%
53	1069	0.6%
Other values (98)	2813	1.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
49	1	< 0.1%
51	6	< 0.1%
52	50	< 0.1%
53	1069	0.6%
53.1	1	< 0.1%
53.2	8	< 0.1%
53.3	17	< 0.1%
53.4	7	< 0.1%
53.5	10	< 0.1%
53.6	40	< 0.1%

Value	Count	Frequency (%)
79	1	< 0.1%
76	1	< 0.1%
70	5	< 0.1%
69	10	< 0.1%
68	20	< 0.1%
67	32	< 0.1%
66	114	0.1%
65	157	0.1%
64.4	1	< 0.1%
64	376	0.2%

x
Real number (ℝ)

HIGH CORRELATION

Distinct	522
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.7153121

Minimum	0
Maximum	9.65
Zeros	3
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	0
5-th percentile	4.29
Q1	4.7
median	5.7
Q3	6.51
95-th percentile	7.58
Maximum	9.65
Range	9.65
Interquartile range (IQR)	1.81

Descriptive statistics

Standard deviation	1.1094222
Coefficient of variation (CV)	0.19411401
Kurtosis	-0.80100603
Mean	5.7153121
Median Absolute Deviation (MAD)	0.92
Skewness	0.36104978
Sum	1106330.1
Variance	1.2308175
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4.32	2094	1.1%
4.34	2010	1.0%
4.38	1986	1.0%
4.37	1938	1.0%
4.33	1812	0.9%
4.31	1761	0.9%
4.35	1685	0.9%
4.41	1644	0.8%
4.36	1568	0.8%
4.3	1558	0.8%
Other values (512)	175517	90.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	3	< 0.1%
3.75	2	< 0.1%
3.77	7	< 0.1%
3.78	5	< 0.1%
3.79	4	< 0.1%
3.81	7	< 0.1%
3.82	6	< 0.1%
3.84	9	< 0.1%
3.85	2	< 0.1%
3.86	9	< 0.1%

Value	Count	Frequency (%)
9.65	1	< 0.1%
9.51	1	< 0.1%
9.46	1	< 0.1%
9.43	1	< 0.1%
9.42	4	< 0.1%
9.36	3	< 0.1%
9.35	1	< 0.1%
9.3	1	< 0.1%
9.24	1	< 0.1%
9.1	1	< 0.1%

y
Real number (ℝ)

HIGH CORRELATION

Distinct	521
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.7200944

Minimum	0
Maximum	10.01
Zeros	2
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	0
5-th percentile	4.31
Q1	4.71
median	5.72
Q3	6.51
95-th percentile	7.58
Maximum	10.01
Range	10.01
Interquartile range (IQR)	1.8

Descriptive statistics

Standard deviation	1.1023335
Coefficient of variation (CV)	0.19271246
Kurtosis	-0.81066804
Mean	5.7200944
Median Absolute Deviation (MAD)	0.92
Skewness	0.35675813
Sum	1107255.8
Variance	1.2151391
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4.38	2163	1.1%
4.35	2088	1.1%
4.34	1986	1.0%
4.37	1911	1.0%
4.31	1854	1.0%
4.39	1719	0.9%
4.33	1711	0.9%
4.36	1625	0.8%
4.32	1618	0.8%
4.41	1593	0.8%
Other values (511)	175305	90.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2	< 0.1%
3.71	1	< 0.1%
3.72	7	< 0.1%
3.73	1	< 0.1%
3.75	2	< 0.1%
3.77	4	< 0.1%
3.78	9	< 0.1%
3.79	2	< 0.1%
3.8	1	< 0.1%
3.81	5	< 0.1%

Value	Count	Frequency (%)
10.01	1	< 0.1%
9.59	1	< 0.1%
9.46	1	< 0.1%
9.36	1	< 0.1%
9.34	1	< 0.1%
9.31	1	< 0.1%
9.3	2	< 0.1%
9.26	2	< 0.1%
9.24	2	< 0.1%
9.14	1	< 0.1%

z
Real number (ℝ)

HIGH CORRELATION

Distinct	349
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.5342463

Minimum	0
Maximum	31.3
Zeros	10
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	0
5-th percentile	2.66
Q1	2.9
median	3.53
Q3	4.03
95-th percentile	4.684
Maximum	31.3
Range	31.3
Interquartile range (IQR)	1.13

Descriptive statistics

Standard deviation	0.68892211
Coefficient of variation (CV)	0.19492759
Kurtosis	12.818313
Mean	3.5342463
Median Absolute Deviation (MAD)	0.57
Skewness	0.68567148
Sum	684134.67
Variance	0.47461367
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2.69	3523	1.8%
2.7	3305	1.7%
2.68	3289	1.7%
2.71	3087	1.6%
2.72	2887	1.5%
2.73	2747	1.4%
2.67	2628	1.4%
3.99	2542	1.3%
4.02	2430	1.3%
4.01	2384	1.2%
Other values (339)	164751	85.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	10	< 0.1%
1.05	1	< 0.1%
2.24	2	< 0.1%
2.26	1	< 0.1%
2.27	2	< 0.1%
2.28	1	< 0.1%
2.3	4	< 0.1%
2.31	9	< 0.1%
2.32	5	< 0.1%
2.33	7	< 0.1%

Value	Count	Frequency (%)
31.3	1	< 0.1%
8.4	1	< 0.1%
8.35	1	< 0.1%
8.18	1	< 0.1%
6.03	1	< 0.1%
5.75	1	< 0.1%
5.73	1	< 0.1%
5.69	1	< 0.1%
5.67	2	< 0.1%
5.65	1	< 0.1%

price
Real number (ℝ)

HIGH CORRELATION

Distinct	8738
Distinct (%)	4.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3969.1554

Minimum	326
Maximum	18818
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	1.5 MiB

Quantile statistics

Minimum	326
5-th percentile	544
Q1	951
median	2401
Q3	5408
95-th percentile	13298
Maximum	18818
Range	18492
Interquartile range (IQR)	4457

Descriptive statistics

Standard deviation	4034.3741
Coefficient of variation (CV)	1.0164314
Kurtosis	2.106914
Mean	3969.1554
Median Absolute Deviation (MAD)	1678
Skewness	1.6055812
Sum	7.6832132 × 10⁸
Variance	16276175
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
544	542	0.3%
605	464	0.2%
789	454	0.2%
828	438	0.2%
776	437	0.2%
802	435	0.2%
552	427	0.2%
561	416	0.2%
625	414	0.2%
596	401	0.2%
Other values (8728)	189145	97.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
326	15	< 0.1%
335	11	< 0.1%
336	11	< 0.1%
337	5	< 0.1%
338	11	< 0.1%
344	5	< 0.1%
345	15	< 0.1%
348	5	< 0.1%
351	25	< 0.1%
357	31	< 0.1%

Value	Count	Frequency (%)
18818	6	< 0.1%
18804	9	< 0.1%
18795	10	< 0.1%
18791	15	< 0.1%
18787	5	< 0.1%
18780	6	< 0.1%
18766	12	< 0.1%
18760	6	< 0.1%
18759	9	< 0.1%
18757	8	< 0.1%

Auto

Heatmap
Table

	carat	clarity	color	cut	depth	price	table	x	y	z
carat	1.000	-0.367	0.246	0.131	0.042	0.971	0.236	0.997	0.996	0.995
clarity	-0.367	1.000	0.091	0.115	-0.080	-0.245	-0.182	-0.365	-0.362	-0.369
color	0.246	0.091	1.000	0.041	0.041	0.173	0.038	0.243	0.244	0.247
cut	0.131	0.115	0.041	1.000	-0.215	-0.140	-0.558	-0.150	-0.149	-0.173
depth	0.042	-0.080	0.041	-0.215	1.000	0.030	-0.155	-0.007	-0.008	0.110
price	0.971	-0.245	0.173	-0.140	0.030	1.000	0.223	0.972	0.972	0.968
table	0.236	-0.182	0.038	-0.558	-0.155	0.223	1.000	0.240	0.234	0.211
x	0.997	-0.365	0.243	-0.150	-0.007	0.972	0.240	1.000	0.998	0.990
y	0.996	-0.362	0.244	-0.149	-0.008	0.972	0.234	0.998	1.000	0.990
z	0.995	-0.369	0.247	-0.173	0.110	0.968	0.211	0.990	0.990	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	carat	cut	color	clarity	depth	table	x	y	z	price
0	1.52	4	3	4	62.2	58.0	7.27	7.33	4.55	13619
1	2.03	3	7	2	62.0	58.0	8.06	8.12	5.05	13387
2	0.70	5	4	5	61.2	57.0	5.69	5.73	3.50	2772
3	0.32	5	4	5	61.6	56.0	4.38	4.41	2.71	666
4	1.70	4	4	4	62.6	59.0	7.65	7.61	4.77	14453
5	1.51	3	7	3	62.8	58.0	7.34	7.29	4.59	7506
6	0.74	5	2	4	61.8	57.0	5.76	5.79	3.57	3229
7	1.34	4	4	2	62.5	57.0	7.00	7.05	4.38	6224
8	0.30	5	3	8	62.0	56.0	4.35	4.37	2.70	886
9	0.30	2	7	5	63.6	57.0	4.26	4.28	2.72	421

	carat	cut	color	clarity	depth	table	x	y	z	price
193563	0.28	3	2	3	61.2	55.0	4.23	4.26	2.60	484
193564	0.90	2	1	3	63.2	57.0	6.11	6.14	3.88	4919
193565	0.31	4	1	3	62.6	58.0	4.32	4.29	2.69	732
193566	1.05	5	4	5	62.1	56.0	6.54	6.51	4.06	7397
193567	0.58	5	2	4	61.8	57.0	5.33	5.36	3.31	1872
193568	0.31	5	1	6	61.1	56.0	4.35	4.39	2.67	1130
193569	0.70	4	4	6	60.3	58.0	5.75	5.77	3.47	2874
193570	0.73	3	3	3	63.1	57.0	5.72	5.75	3.62	3036
193571	0.34	3	1	3	62.9	55.0	4.45	4.49	2.81	681
193572	0.71	2	2	2	60.8	64.0	5.73	5.71	3.48	2258

Overview

Variables

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Interactions

Correlations

Missing values

Sample